From Gesture to Action: Natural User Interfaces
نویسنده
چکیده
It is time to go beyond the established approaches in user-system interaction (USI). After a serious critic of well established interaction styles we discuss the two known approaches to overcome the obstacles and limitations: (1) [immersive] Virtual Reality (VR), and (2) Augmented Reality (AR). Both design strategies are diametrically opposed: VR enriches the virtual world with real humans, while AR augments the real world with intelligent features. Only with the AR design strategy humans are able to behave as much as possible in a natural way: behavior of humans in the real world with other humans and/or real world objects. Our interest in user centred design let us follow this idea. Based on the fundamental constraints of natural way of interacting we derive a set of recommendations for the next generation of user interfaces: the Natural User Interface (NUI). The concept of NUI is discussed in form of a general framework and in form of several NUI-like applications. Finally we describe the interdisciplinary research topics that must be taken into consideration to come up one day--in the near future--with a welldesigned NUI. 1. Why do we need a new interaction technique?
منابع مشابه
Human Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملUsing clustering techniques for intelligent camera-based user interfaces
The area of Human-Machine Interface is growing fast due to its high importance in all technological systems. The basic idea behind designing Human-Machine interfaces is to enrich the communication with the technology in a natural and easy way. Gesture interfaces are a good example of transparent interfaces. Such interfaces must identify properly the action the user wants to perform, so the prop...
متن کاملDepth Camera-Based 3D Hand Gesture Controls with Immersive Tactile Feedback for Natural Mid-Air Gesture Interactions
Vision-based hand gesture interactions are natural and intuitive when interacting with computers, since we naturally exploit gestures to communicate with other people. However, it is agreed that users suffer from discomfort and fatigue when using gesture-controlled interfaces, due to the lack of physical feedback. To solve the problem, we propose a novel complete solution of a hand gesture cont...
متن کاملTowards the creation of a Gesture Library
The evolution of technology has risen new possibilities in the so called Natural User Interfaces research area. Among distinct initiatives, several researchers are working with the existing sensors towards improving the support to gesture languages. This article tackles the recognition of gestures, using the Kinect sensor, in order to create a gesture library and support the gesture recognition...
متن کاملGesture Friendly Interfaces for Classroom Teaching with Thinking Tools
Thinking tools are typically designed for students working on their own computers. When used from the front of a classroom, the complex graphical user interfaces of these tools can interfere with an instructor's ability to lecture effectively and to use natural gestures. A thinking tool for the grade 9 mathematics topic of "relationships" has been developed with a more gesture-friendly interfac...
متن کامل